Skip to main content

Law2Vec: Legal Word Embeddings

Item Preview

There Is No Preview Available For This Item

This item does not appear to have any files that can be experienced on Archive.org.

Show all files

software

Law2Vec: Legal Word Embeddings

by
Ilias Chalkidis

Usage
Public Domain Mark 1.0Creative Commons Licensepublicdomain
Topics
legal word embeddings, word2vec
Language
English
In this work, we present Law2Vec. In order to train Law2Vec we used a large amount of legal corpora from various public legal sources in  English. The list comprises the following :
  •  53,000  pieces of UK legislation (e.g. UK Public General Acts, Local Acts, etc.) published in (http://legislation.gov.uk).
  • 62,000 pieces of European legislation (e.g. EU Treaties, Regulations, Directives, etc.) published in Eur-Lex (https://eur-lex.europa.eu/) .
  • 5,500 pieces of Canadian legislation (e.g. Consolidated Acts, Constitutional Documents, etc.) published in (http://laws.justice.gc.ca/eng).
  • 1,150 pieces of Australian legislation published in (https://www.legislation.gov.au/).
  • 800 pieces of English-translated legislation from EU countries (e.g. Finland, Sweden, France, Germany, etc.).
  • 780 pieces of English-translated Legislation from Japanese published in (http://www.japaneselawtranslation.go.jp).
  • 68 bound volumes of the US Supreme Court decisions from 1998 to 2017, published in (https://www.supremecourt.gov/opinions/boundvolumes.aspx).
  • 54 titles of the most recently updated U.S. Code, as presented in (https://www.law.cornell.edu/uscode/text).
The corpus includes in total 123,066 documents which consists of 492M individual words (tokens) including punctuation marks and numbers. The corpus was preprocessed to discard non-UTF8 encoded characters and treat separated words due to different layout styles (e.g. text from PDF documents). The text was sentence tokenised using the nltk library to provide the best possible input for models. All words were lower-cased and all numerical digits where replaced by the character ’D’, as in Chalkidis et al. (2017) for normalization.

We selected to train word2vec models, instead of the most recent fasttext implementation. The main reason is that word2vec still seems to provide bet- ter semantic representation than fasttext, which tend to be highly biased to- wards syntactic information as also the computed n-gram embeddings. Missing words (OOV) is not of concern in most legal-related tasks, as legislators, lawyers and other legal professionals articulate in high quality standards. We empirically observed that legal documents have been consistent by means of misspellings, grammatical-syntactical errors as well as the vocabulary used has been formal and pertinent to the domain.

We trained two individual word2vec models for 100-dimensional and 200- dimensional embeddings using the gensim library. 
Addeddate
2018-06-29 15:08:47
Identifier
Law2Vec
Scanner
Internet Archive HTML5 Uploader 1.6.3

plus-circle Add Review
comment
Reviews

Reviewer: benphua - favoritefavoritefavoritefavoritefavorite - August 28, 2020
Subject: Thank You
Thank you for doing this it will surely save a lot of time
Reviewer: luilom90 - favoritefavoritefavoritefavoritefavorite - June 10, 2019
Subject: Pre-processing
Hi, I'm really interested about Law2vec.
In tokenization process, you have replaced digit and used nltk to tokenize your training dataset. Have you used lemmatization and stemming also?

1,407 Views

1 Favorite

2 Reviews

DOWNLOAD OPTIONS

download 2 files
TEXT
Uplevel BACK
download 1 file
TORRENT download
download 7 Files
download 7 Original
SHOW ALL

IN COLLECTIONS

Unsorted Datasets The Dataset Collection

Uploaded by kiddothe2b on

SIMILAR ITEMS (based on metadata)

Terms of Service (last updated 12/31/2014)